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ABSTRACT 

To ensure high quality courses and services at 
Louisiana State University Evening School (Baton Rouge), a program 
evaluation was designed to aid in decision making. The plan developed 
and initially implemented in 1991-92 represents a beginning effort in 
a continuous process of evaluation. The initial focus was on 
instruction. The object of this study was to explore students' 
perspectives of the program as a whole and to develop an instrument 
that can provide a large quantity of data that instructors can use to 
enhance students' learning. After a review of existing instruments, a 
68-item Student Assessment of Teaching and Learnin" (SATL) was 
drafted and administered to an initial sample of 755 evening school 
students. Reliability and validity were studied, and various 
exploratory factor analyses were completed to examine the original 
content classification of. SA.TL items. Results provide empirical 
support for the construct ^'alidity and reliability of the measure, 
which is a welcome alternative to usual student rating forms in that 
it focuses on teaching and learning higher order thinking skills. 
Results further suggest that student perceptions of the teaching and 
learning environment have little or no relationship to student 
beliefs about expected course grades. Implications for future use of 
the SATL are discussed. Six tables and one figure present study 
findings. The SATL is included. (SLD) 
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Development of a Student Perceptions Instrument to Assess 
Contributions of the Learning Environment to the Enhancement 
of Student Learning in Higher Education Settings 

Purpose 

To ensure the high quality of credit courses/programs and services offered through the 
LSU Evening School, a program evaluation plan v/as designed to profile current performance 
and provide information for making decisions about programs, procedures, and policies. Such 
a plan for evaluation was seen as a necessary component of any program innovation, so that 
ownership of the evaluation is shared with stakeholders, both internal and external, and 
decisionmakers can make informed decisions. The effective planning and implementation of 
such an evaluation has the potential for increasing support for Evening School programs from 
both the academic community and external stakeholders. 

The plan developed and initially implemented during 1991-92 represents a beginning 
effort in a continuous process of analyzing, planning, implementing, revising, and renewing the 
change effort to address new challenges. It is envisioned that this effort will help the division 
to prepare for the Southern Association of Colleges and Schools (SACS) accreditation visit and 
establish a process for continually improving performance which is data-based. The existence 
of such a process lets students, parents, faculty, staff, and business and community groups know 
that the quality of services and student learning is valued in the Evening School it LSU. 

During the initial program evaluation efforts, a framework was developed to profile 
current performance relative to three broad domains: (1) Instruction, (2) Student Services, and 
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(3) Administration. This long-range plan provided for data to be collected from a variety of data 
sources to reflect the multiple perspectives of students, faculty, staff, and the external 
community (See Figure 1,) Initial efforts during 1991-92 focused on the first domain. 
Instruction, and the development of an instrument to assess student perceptions of teaching which 
would provide specific, confidential feedback to instructors for faculty development purposes. 
Specifically, this report summarizes the results of developing and field testing an instrument in 
Evening School classes at LSU, to assess students' perceptions of important teaching and 
learning environment variables in higher educarion contexts. This sensitivity to context is 
important in developing instruments to gather students' perceptions to provide feedback for 
teaching enhancement, since students in continuing education classes are often non-traditional, 
adult learners. The focus of concern in this study is students' perspectives of the program as 
a whole and the development of an instrument that can provide a large quantity of specific data 
that instructors can use to analyze their teaching and make modifications to enhance the learning 
of students in their courses. It is not an evaluation of individual instructors. The data collected 
in this study was used for planning purposes and to provide specific feedback to instructors for 
their use. 

Of particular interest is the instrument focus on newer assessment concerns (e.g., 
teaching thinking skills) which are not addressed in other student perceptions measures. An 
important purpose of the study was to empirically test a response format which taps students' 
perceptions of the extent to which their personal learning is enhanced by various research-based 
indicators of effective teaching and learning. The construct validity of the instrument and initial 
reliabilities were also empirically examined. 
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Figure 1: LSU Evening School 
Program Evaluation Model 
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Perspectives 

The quality of undergraduate teaching and learning environments on college campuses 
is a recent national concern. The call to "reaffirm teaching as the university's primary task" is 
echoed by the Carnegie Foundation for the Advancement of Teaching in its proposal to redefine 
"scholarship" in ways that emphasize the importance of improving undergraduate teaching and 
learning environments. Literature reviews by Purtle (1982) and Aleamoni (1987) reveal that 
considerable evidence supports the use of student ratings as one data source in the assessment 
of course characteristics and the quality of instruction, particularly when such information is 
used for formative evaluation purposes. Whilj some learning environment Instruments have 
been developed for use in higher education settings, (e.g., the College and University Classroom 
Environment Inventory TCUCEI) , Fraser, Treagust, & Dennis, 1986), no measures are known 
that attempt to assess students* perceptions in higher education settings of the extent to which 
teaching and learning environment variables enhance learning , particularly in newer, important 
areas such as the development of higher order thinking skills. Fraser, Treagust, Williamson 
& Tobin (1987), citing the strong tradition of classroom environment research using student 
perceptions measures at the primary and secondary school levels, suggest that this research 
should form a basis for the development of classroom learning environment perceptions suitable 
for use in higher education contexts. Menges (1992) also recommends that researchers in 
teaching in higher education contexts look to the more advanced research base of effective 
teaching in elementary and secondary schools as a starting point in investigating teaching and 
learning in higher education classes. During the last ten years, much has been leam.ed about 
important teaching behaviors and their contribution to student engagement and the enhancement 
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of student learning (Brophy, 1986; Porter & Brophy, 1988). Research in the study of learning 
environments has revealed that student outcomes in various educational settings depend to a large 
extent on the nature of the actual classroom environment (Fraser &c Fisher, 1983; Fraser et al., 
1987; Marceio, 1990). Logan and EUett (1988) suggest that even though higher education 
settings are somewhat different teaching and learning contexts than public school classrooms, 
it seems reasonable that the recent process product-research literature, literature on classroom 
learning environments and research on student learning, should provide an initial focus for the 
development of an instrument to measure effective teaching and learning environments in higher 
education contexts. In addition, the extent to which students' learning is enhanced in higher 
education classroom contexts is an important assessment concern, from both formative and 
summative evaluation perspectives. 

Methodology 

Literature Review : Initially, some 30 different instruments targeting student evaluations 
of instruction and assessments of learning environments in higher education classes were 
reviewed as to content and response format. None of these instruments was found to have a 
primary focus on the actual processes and interactions of teaching and learning within the higher 
education classroom learning environment. With few exceptions, these instruments focused upon 
the evaluation of course content, activities, materials and/or personal characteristics of the 
instructor. Moreover, since students attending classes taught through the Evening School are 
composed largely of non-traditional, adult learners, a primary focus ot this study was the 
development of a student perceptions measure that would provide specific feedback to professors 
as they worked to create courses which would take into consideration the special needs and 
concerns of adult learners. 
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An initial student perceptions assessment framework for use in higher education learning 
environments was developed for this study. Instrument contents were derived from a synthesis 
of literature, models and perceptions measures in the study of classroom learning environments 
(Moos, 1974; Fraser, Anderson & Walberg, 1987; Fraser & Fisher, 1983; Fraser et al., 1987, 
EUett, Loup & Chauvin, 1991; Loup, Ellett & Chauvin, 1992) and from a synthesis of process- 
product research (Brophy, 1986) and review of large-scale teacher performance assessment 
instruments developed to evaluate teaching in public school contexts in Georgia, Florida, and 
Texas (Ellett, Garland & Logan, 1987) and more recent assessment concerns such as the 
teaching of thinking skills and learning equity reflected in the System for Teaching and learning 
Assessment and Review (STAR) (Ellett, Loup & Chauvin, 1991). The resulting 68 item draft 
of a student perceptions measure, the Student Assessment of Teaching and Learning (SATL), 
was designed to assess the interactive nature of the classroom teaching and learning environment 
in higher education settings. A copy of the SATL is included in the appendix. 

Assessment Domains : The initial draft of the 68 assessment items of the SATL consisted 
of indicators of effective teaching and learning grouped by four instrument categories: 

I. Preparation and Classroom Management (11 indica.^ors) 

IL Interpersonal Skills (10 indicators) 

in. Enhancement of Learning (24 indicators) 

IV. Student Evaluation Practices (10 indicators) 
The response format for each of these indicators was a three-point forced choice, format: (1) 
Ineffective-does not positively enhance student learning, (2) Effective-for the most part, 
positively enhances student learning, and (3) Highly Effective- consistently enhances student 
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learning to a high degree. A SATL assessment indicator is a comprehensive statement of 
teaching and learning activity rather than a course characteristic or simple stat^jment describing 
a teaching behavior. 

Additionally, in a second part of the instrument (10 items) students were asked to rate 
the degree to which each type of learning (critical analysis and/or problem solving, creative 
thinking, learning factual information, etc.) is emphasized in the particular course. In a third 
part (3 items), students were asked to give an overall evaluation of the quality of teaching, the 
contribution of the course to their learning, and an overall course grade. 

Sample : The original sample for this study consisted of 755 students enrolled in 34 LSU 
Evening School courses during the spring semester. 1992, Students in the sample were enrolled 
in classes in 12 different locations where Evening School courses are taught: Broadmoor High 
School, LSU main campus» Baton Rouge General School of Nursing, Sherwood Center, 
Alexandria, Eunice, Lake Charles, New Orleans, Plaquemine, Shreveport, Vicksburg, and West 
Monroe. A wide range of subject areas was represented, including English, French, history, 
mathematics, speech and communications, biology, finance, journalism, microbiology, 
philosophy, psychology, religion, sociology, Spanish, zoology, human ecology, kinesiology, 
educational administration, curriculum and instruction, economics, management, industrial 
engineering, petroleum engineering, art, library science, vocational education and experimental 
statistics. Courses were at all levels, 1000-5000 and 7000, and represented introductory level 
survey courses as well as doctoral-level special topics courses. Class sizes ranged- from nine to 
55 students. 

Data Collection : An initial field trial of the SATL was completed during the spring of 
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1992 with a random sample of students in Evening School classes at LSU using a cross-section 
of courses which represent a wide variety of higher education contexts. One purpose of this 
field trial was to establish initial estimates of item and instrument category descriptive statistics 
and internal consistency reliabilities. A second purpose was to generate student perceptions data 
for examining construct validity characteristics using a series of exploratory factor analyses. The 
SATL was administered confidentially to students in class groups and required approximately 
15 minutes to complete. 

Classes were randomly selected within subject areas and locations to represent a wide 
variety of classroom contexts in the study. Instructors in the sample were contacted by letter 
and asked to cooperate in having their students complete the student perception instruments as 
part of a development effort to design a consistent student course/instructor perception 
instrument for Evening School courses. It was explained that the focus of the study was 
students' perspectives of the program as a whole and that the data would be used for planning 
purposes and to provide meaningful feedback to instructors. Class summaries were considered 
to be confidential and were not reported to academic departments. 

Both the instrument and the process were piloted, and instructors were asked for their 
feedback as well as that of their students. An Instructor Input Sheet was included to gather 
information about the appropriateness and comprehensiveness of the items, the length of time 
required for administration, etc. 

Instructors were asked to plan time (approximately 20 minutes) during the hst two weeks 
of class, but not during the exam, for students to complete the task. Students were asked to 
complete the instrument, a demographic sheet, and a comment/response sheet, which asked for 
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comments about the instructor/course, the clarity of directions and items, appropriateness of 
items for this particular course, and any important aspects of teaching and learning that were not 
included in the instrument. Students were also asked to indicate how long it took them to 
complete the instrument. 

Student perception Instruments were distributed and returned by campus mail and U.S. 
mail. Follow-up calls were made to instructors after the end of the semester. Of the 34 classes 
in the original sample, 28 participated in the study, for a r esponse rate of 82%. Two of the 
classes did not participate for extenuating circumstances. In one, the professor left at midterm 
and a graduate student was teaching the course; in another, the course had an unusual schedule 
and began and ended three weeks before the regular semester in order to accommodate the 
public schools involved in the program. In this class, students were gone before the instruments 
arrived. 

In these 34 classes, 755 students were enrolled at the beginning of the semester. 
Demographic data in Table 1 indicate that a majority of students are female (67.2%) and r 
majority of students are over the age of 25 (66.8%). Only 7.4% of students in the sample were 
of the traditional college age. Slightly more than one-half were enrolled in a degree program. 
Almost two-thirds were part-time students, and 47% had not taken a college course within one 
to three yeai's of this semester. For more than 22% of the students in the sample, this was their 
first college course in 10 or more years. Data were collected from 380 students. Considering 
traditionally high withdrawal rates in continuing education courses, this number seems 
reasonable. 

Data Analyses : A variety of data analyses were completed to examine the reliability and 
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construct validity characteristics of the SATL. These included: 

1. Descriptive statistical summaries for each item (assessment indicator) 

2. A vai-iety of principal component, oblique and orthogonal factor analyses 

3. Alpha reliability analyses for SATL (Parts I, II, III) subscale scores 

4. Intercorrelations among SATL (Pans I, II, III) subscale scores 

5. Intercorrelations among expected course grades and SATL (Parts I, II, III) items 

Results 

A variety of exploratory factor analyses were completed to examine the original content 
classification of SATL items into the four Assessment Domains. Results of a one-factor solution 
indicated that the 55 items comprising Assessment Domains I, II and III meaningfully loaded on 
a single factor (range of loadings =.38 to .83), with 46 of 55 loadings exceeding .60 (Table 2). 
This solution accounted for 45% of che total variation in the data. Subsequently, a series of 
oblique and orthogonal solutions extracting from two to ten factors was completed. Fur oblique 
solutions, a large number of items cross-loaded on more than one factor. Results of a four- 
factor, orthogonal solution best depicted the alignment of SATL indicators with the various 
Assessment Domains. Factor loadings for this solution ranged from .36 to .77 with 21 loadings 
at or exceeding .60 (Table 3). This solution accounted for 56.23% of the total variance in the 
data, with 12 of 55 indicators (items) cross-loading on more than one factor. Examination of 
cross-loadings suggested that more generic concepts related to student/ teacher communications 
(eg. clarity in directions, explanations and grading) tended to conceptually align vdth more than 
one SATL assessment domain. For the most part, the patterning of loadings confirmed the 
logical classification of indicators by domains and represented the best statistical and conceptual 
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fit with the original structure of the SATL. 

Descriptive statistics for items and factored dimensions (domains/subscales) indicated that 
instructors received relatively consistent scores (80.7% to 86.4% of the maximum possible 
score) across SATL Assessment Domains (Table 4). Lowest percentages were noted for the 
Assessment Domain, Enhancement of Learning, which includes newer assessment concepts such 
as involving students in higher order thinking. Alpha reliability coefficients for each SATL 
Assessment Domain ranged from .89 (I: Preparation and Classroom Management) to .96 (III: 
Enhancement of Learning) (Table 5). Other alpha reliability coefficients were as follows: 
Interpersonal Skills, .91; Student Evaluation Practices, .93; Types of Learning, .90; and Overall 
Evaluation, .92. Jntercorrelations among SATL subscales for the total sample of students ranged 
from .76 (p<.0001) (Enhancement of Learning and Interpersonal Skills) to .20 (p<.0001) 
(Student Evaluation Practices and Overall Evaluation). Intercorrelations between the SATL 
Overall Course Evaluation component and the four SATL domains (subscales) ranged from .20 
(p< .0001) to .29 (p< .0001) (Table 6). Intercorrelations of students' perceptions of expected 
grades at both the beginning and conclusion of the course were typically negative, relatively 
moderate in magnitude, and not statistically significant. 

Importance/Significance 

The results of this study are important from four major perspectives. First, they provide 
empirical support for the construct validity and reliability of a new, comprehensible measure of 
students' perceptions of characteristics of teaching and learning environnnents in higher education 
settings, particularly in classes composed • ' non-traditional adult learners, which represent 
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different contexts within the higher education setting. The focus of the SATL on characteristics 
of teaching and the enhancement of learning makes it unique in the higher education learning 
environment assessment literature. While other student percepdons of learning environment 
characteristics for use in higher education settings have been developed (e.g., the CUCEI), these 
do not have as a central focus students' views of the extent to which research -based indicators 
of teaching and learning activities and learning environment variables enhance learning . The 
SATL is unique in this regard relative to its focus on teaching and learning higher order thinking 
skills, and it can provide important information for formative and summative evaluation 
purposes, and for future research and theory development in the study of learning environments 
in higher education. From an evaluation of teaching perspective, the SATL provides a rich 
alternative to the wide variety of student rating forms typically used in higher education settings 
that have a simpler and more narrow focus on instructor or course evaluations . 

Secondly, the results suggest that students' perceptions of the teaching and learning 
environment as measured by the SATL have little or no relationship to students' beliefs about 
expected course grades at either the beginning or the end (after final examinations) of a course. 
This finding suggests that the SATL response format is relatively independent of such student 
expectations and calls into question past criticisms of the use of student perception measures to 
assess (evaluate) higher education classrooms. Thus, such student perceptions may be relatively 
free of the influence of halo and pitchfork effects associated with grades that are commonly 
believed to influence students' perceptions of the quality of teaching in higher education 
classrooms. 

Third, the results showed that the SATL assessment indicators targeting the teaching. 
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development and learning of higher order thinking skills received the lowest ratings by students. 
These findings suggest that these higher education learning environments were not characterized 
by the teaching and learning of higher order cognitive skills, but instead were perceived by 
students as primarily focused on factual knowledge acquisition using traditional, receptive 
teaching and learning modes. 

Finally, the results have implications for using the SATL in the future study of learning 
environment characteristics, and for conducting studies to establish systematic lines of inquiry 
and to develop more comprehensive theories of effective teaching and learning environments in 
higher education settings. Written comments solicited from students and instructors indicate that 
the SATL is easy lo administer, clear, and adequately addresses important aspects of the course 
and instructor. It takes approximately 20 minutes to administer and yields useful summary data 
to instructors to analyze important aspects of teaching and learning. 

Follow-up and Next Steps 

Student perception data collected using the SATL were summarized for each instructor 
using the percentages of each response (highly effective in enhancing learning, effective in 
enhancing learning, inefff^tive in enhancing learning) for each assessment indicator, grouped 
by subscales. Computer printouts of SATL results were provided in a confidential manner to 
each instructor in the sample, along with procedures to follow in analyzing the results and 
reflecting upon changes that may be considered to enhance learning in their classec; No attempt 
was made to evaluate individual instructors. 



In the fall of 1993, continued development of the SATL using all Evening School classes 
at LSU is recommended. Specifically, this next phase would involve the following: 

(1) Assess all courses taught through the Evening School at the end of the fall 1992 and 
spring 1993 semesters to provide specific, confidential feedback to individual professors 
and to examine the strengths and weaknesses of program as a whole. 

(2) For half of the students in each class, use a new, 5-point response format, which would 
allow for greater variation in item responses. Compare the results with those from the 
3-point response format used with the remainder of the class. 

(3) Develop a self-assessment version of the SATL and encourage instructors to assess 
themselves on a parallel version of the student perceptions instrument. Compare the self- 
assessment score and the mean score for the student perceptions instrument for each 
subscale and item. 

(4) Observe a random sample of classes using the SATL and knowledgeable observers 
(developers). For these classes, triangulate the scores of the outside observer, students, 
and the instructor. P\?s\ and conduct conferences with the instructor to share data for 
enhancement and to gain input into the observation process, usefulness of data, etc. from 
the instructor. 

(5) Conduct a content verification survey of faculty about applicability to their teaching and 
learning context. 

(6) Develop a technical administration manual to accompany the SATL. 

In gathering data from instructors about their own teaching and students' learning, a 
second perspective in the program evaluation model will be gained relative to the Instruction 
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domain (Instruction X Faculty) (Figure 1). This systematic gathering of data from a variety of 
perspectives related to key domains of the higher education learning environment, combined with 
the use of such data in a continuous cycle of analyzing, planning, implementing, and evaluating 
outcomes, has the potential to significantly impact educational opportunities for non-traditional 
learners in Evening School classes at LSU. 
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TABLE 1 



Summary of Demographic Information 
for the Total Sample of SATL Respondents 
(n=339) 




Demographic Information 

1. Sex: Female 

Male 

2. Age: Under 21 

21 - 25 
26 - 30 
31 - 35 
36 - 40 
41 - 45 
46 - 50 
51 -55 
Over 55 

3. Enrolled in a degree program: 

Yes 
No 

4. Present course part of degree program: 

Yes 
No 

5. Student Classification: 

Freshman 

Sophomore 

Junior 

Senior 

Graduate 

6. Intent to Enter Degree Program: 



% of Respondents 

67.2 
32.8 

7.4 
25.8 
12.8 
16.5 
12.8 
11.9 

6.5 

3.5 

2.8 



54.7 
45.3 



69.6 
30.4 



16.0 
18.4 
21.9 
24.6 
19.1 



Yes 
No 



52.7 
47.3 



o 
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7. FuU-Time student (9 hours +) 

Yes 35.8 

No 64.2 

8. Present or prior courses taken on LSU Campus: 

Yes 76.8 

No 23.2 

9. Prior courses taken in Continuing Education: 

Yes 51.8 

No 48.5 

10. Length of time since last college course: 

1st course 12.0 

1 - 3 years 47.0 

4 - 9 years 17.5 

10 or more years 22.9 

11. Grade anticipated at beginning of semester: 

A 48.6 

B 39.5 

C 11.9 
D 
F 

12. Grade anticipated at end of semester: 

A 46.5 

B 38.6 

C 12.9 

D 1.4 

F 0.7 
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TABLE 2 



Summary of SATL Indicators of Effective Teaching and Learning 

Factor Pattern Loadings for a One-Factor Solution 
for Each Assessment Domain (n=339) 



INDICATOR NUMBER FACTOR PATTERN LOADING 



ASSESSMENT DOMAIN I: Preparation and Classroom Management 



1. 


Objectives for the course are clearly communicated. 


.63 


2. 


Objectives for each class are clearly cnmmnnicareH. 


.65 


3. 


Student responsibilities and expectations are clearly explained. 


.62 


4. 


The professor is well-prepared for class. 


.58 


5. 


Class starts and ends on time. 


.38 


6. 


Time during class is efficiently used for teaching and learning. 


.60 


7. 


The course activities over the semester are well-organized. 


.64 


8. 


Class activities help to achieve the objecti'ves of the course. 


.68 


Q 


Assigned readings (textbook and/or other) are meaningful. 


.57 


10. 


Outside assignments help to achieve the course objectives and are 


.57 




integrated with class activities. 






Teaching and learning techniques motivate students to learn. 


.79 


ASSESSMENT DOMAIN II: Interpersonal Skills 




12. 


The professor is enthusiastic about teaching this course. 


.59 


13. 


The professor is enthusiastic about students' learning in this 


.67 




course. 




14. 


The professor maintains a cliamte conducive to learning. 


.69 


15. 


The professor relates the subject to everyday life. 


.65 


16. 


Students are encouraged to express their own ideas. 


.59 


17. 


Students are encouraged to participate in discussions. 


.52 


18. 


A climate of mutual courtesy and respect is maintained. 


.69 


19. 


The professor demonstrates interest in the progress of individual 


.71 




students. 




20. 


The professor is willing to provide outside help and guidance. 


.65 


21. 


The professor is sensitive to the needs and feelings of students. 


.70 


ASSESSMENT DOMAIN III: Enhancement of Learning 




22. 


The professor arouses and maintains students' interest in the subject. 


.78 


23. 


Teaching methods stimulate interest in the course. 


.83 


24. 


Tlie professor's speech is audible and easily understood. 


.63 


25. 


Directions and explanations related to course content are clear. 


.70 


26. 


Thought-provoking questions are asked. 


.67 


27. 


Questions are asked that allow students to compare and contiast ideas. 


.63 



28. The professor draws students into discussions among themselves. .59 

29. During classes students are encouraged to interact and leam .59 
from one another. 

30. Topics are summarized before moving on to new topics. .66 

31. Importaji topics or ideas are summarized at the end of class. .67 

32. The professor helps students to organize information and understand .72 
relationships among the topics in the course. 

33. Difficult material is clearly explained. .73 

34. Students are encouraged to ask questions in class. .60 

35. Students' questions are clearly answered. .72 

36. Learning activities are implemented at an appropriate pace. .68 

37. Course content is at an appropriate level of difficulty. .69 

38. Difficult parts of the lesson are emphasized to help students leam. .79 

39. The professor seems to know when the students do not understand. .73 

40. When students are confused, the professor clarifies as needed. .75 

41. Students receive feedback about their learning during the lesson. .77 

42. Adjustments are made in the lesson, as needed, to help students leam. .78 

43. Teaching aids (such as visuals) are used in a way that enhances .65 
learning and broadens understanding. 

44. Learning materials (such as books, handout, lab equipment) are used .62 
in a way that enhances leaming and broadens understanding. 

45. Students are encouraged to apply course content to solve problems .60 
or understand real life situations. 

ASSESSMENT DOMAIN IV: Student Evaluation Practices 

46. The basis for grading is made clear. .62 

47. The basis for the course grade reflects an appropriate balance .65 
among tests, papers, assignments, participation, etc. 

48. Tests reflect the course content. .68 

49. The test questions are clearly phrased. .69 

50. The tests are of reasonable length. .69 

51. The test questions provide a fair chance for students to demonstrate .69 
their knowledge of the subject. 

52. Course assignments are graded fairly. .69 

53. Tests and assignments are retumed in a reasonable length of time. ^64 

54. Sufficient feedback is provided on all graded work. .70 

55. Students have opportunities to determine their own progress in the .67 
course. 



Eigen Value = 24.45 

Proportion of Total Variance Explained by 1 -Factor Solution = 44.45% 
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TABLE 3 



Summary of SATL Indicator Factor Pattern Loadings 
for a Four-Factor Orthogonal Solution 

for Each A ssessmen?. Domain (n=--339) 

FACT0K5 

I II ni IV 

ASSESSMENT DOMAIN I: 
Preparation and Classroom Management 

1. .54 

2. ' .58 

3. .61 

4. .60 

5. .46 

6. .59 

7. .69 

8. .49 .43 

9. .36 .46 

10. .51 

11. .52 .51 

ASSESSMENT DOMAIN II: 
Interpersonal Skills 

12. .57 

13. .68 

14. .47 .48 

15. .51 

16. .77 

17. .73 

18. .60 

19. .60 

20. .37 

21. .64 



1 



I II in IV 



ASSESSMENT DOMAIN HI: 
Enhancement of Learning 



22 


A 1 


A 1 

.41 


23 


CO 


.Jo 


24. 






25. 






26. 






27. 






28. 


70 
. /U 




29. 


.07 




30. 






31. 


,ou 




32. 


-J # 




33. 






34. 




59 


35. 


37 


51 


36. 


69 




37. 


55 




38. 


57 




3Q 


.42 


.48 


40. 


.39 


.46 


41. 


.63 




42. 


.59 




43. 


.61 




44. 


.58 




45. 


.48 
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I II III IV 



ASSESSMENT DOMAIN IV: 
Student Evaluation Practices 

.59 .47 



46. 






.58 


47. 




48. 


.69 


49 


• UU 


50. 


.66 


51. 


.69 


52. 


.68 


53. 


.73 


54. 


.71 


55. 


.66 


Proportion of Total Variance in Data 


16.86 14.10 13.09 



Set Explained by Each Factor in the 
4-Factor Solution 

Proportion of the Total Variance in the Daui 
Set Explained by a 4-Factor Solution = 56.23% 
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TABLE 4 



Summary of Descriptive Statistics for Each Subscale 
of the SAIL Four-Factor Solution for the Total Sample of Students 



Subscale 


N 


iVlCaJl 




Max. 
Poss. 


Max. 

rOSS. 


Planning and Classroom 
Management (11)^ 


448 


27.79 


5.49 


33 


84.2 


Interpersonal Skills (10) 


445 


25.92 


5.07 


30 


86.4 


Enhancement of Learning 
(24) 


445 


58.08 


13.40 


72 


80.7 


Student Evalution Practices 
(10) 


435 


25.18 


5.65 


30 


83.9 



• M% Majc = Subscale Mean Score/Max. Possible Score 
'' Number of Items in Subscale 
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TABLE 5 



Summary of Standardized Alpha Reliability 
Coefficients for SATL Subscales for tlie 
Total Sample of Students 
(n-339) 



Subscale Alpha Coefficient 



Part I 

Preparation and Classroom .89 
Management (11)* 

Interpersonal Skills (10) .91 
Enhancement of Learning (24) .96 
Student Evaluation Practices (10) .93 
Part II 

Types of Learning (10) .90 
Part III 

Overall Evaluation (3) .92 



"Number of Items on Subscale 



TABLE 6 



Summary of Intercorrelations Among SATL 
Subscales for the Total Sample of Students 



SUBSCALES PCM 


IS 


EL 


SEP 


TL 


OE 


Preparation and Classroom 1.00 
Management (PCM) 


.75 


.75 


.68 


.57 


.27 


Interpersonal Skills (IS) 


1.00 


.76 


.62 


.57 


.29 


Enhancement of Learning 
(EL) 




LOG 


.70 


.65 


.28 


Student Evaluation 
Practices (SEP) 






1.00 


.46 


.20 


Types of Learning (TL) 








1.00 


.23 


Overall Evaluation (OE) 










1.00 



*p<.001 (all) 



r 
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STUDENT ASSESSMENT 
OF TEACHING AND LEARNIN(; 
Louisiana State University 
Division of Continuing Education 



B^STRUCnONS TO RESPONDENTS 
This form is designed to assess teaching and learning in college classes. There aie three parts to 
the instrument and a demographic sheet Part I asks questions about teaching, learning, and 
course characteristics. Part n asks about the types of learning in the course. Part III asks for 
overall evaluations of the course and additional comments. 
Do not sign your name. 



DIRECTIONS: Parti 
TeachinglLeaminglCourse Characteristics 
Three scale points are provided for each item. Read each item carefully and then select the one 
scale point which best reflects your judgement about the teaching/learning or course characteris- 
tic. 

The three scale points that follow must be read carefully before completing the assessment form. 
Refer to these scale point descriptions as you read and score each item. 

1 - INEFFECTIVE... This scale point should be selected if, in your view, the particular teach- 

ing/learning aspect or course characteristic does not positively enhance student learning. 

2 - EFFECTIVE... This scale point should be selected if, in your view, the particular teaching/ 

learning aspect or course charactcristic,/or the most part, positively enhances student learn- 
ing. 

3 - HIGHLY EFFECTIVE... This scale point should be selected if, in your view, tiie particular 

teaching/learning aspect or course characteristic consistently enhances student learning to a 
high degree. 

PLEASE CAREFULLY READ AND SCORE EACH ITEM INDEPENDENTLY. That is, 
try not to let your response to one item influence your response to the next item. 



\// respoTiKcs arc contributed anonym nv\l\\ . Yoii sfundd not sif^n 
\(mr name to the instrument or the accompdnyiti^ resptnwe form. 
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PARTI 



* INEFFECTIVE IN ENHANCING LEARNING = 1 
EFFEGT2'^'E IN ENHANCING LEARNING = 2 
HIGHLY EFFECTIVE IN ENHANCING LEARNING = 3 

PREPARATION AND CLASSROOM MANAGEMENT 

1. Objectives for the course are cleaxrly communicated. 

2. Objectives for each class are clearly communicated. 

3. Student responsibilities cind expectations are clearly explained. 

4. The professor is well -prepared for class. 

5. Class starts and ends on time. 

6. Time during class is efficiently used for teaching and learning. 

7. The course activities over the semester are well-organized. 

8. Class activities help to achieve the objectives of the course. 

9. Assigned readings (textbook and/or other) are meaningful. 

10. Outside assignments help to achieve the course objectives and 
are integrated with class activities. 

11. Teaching and learning techniques motivate students to learn. 



INTERPERSONAL SKILLS 

12. The professor is enthusiastic about teaching this course. 

13 . The professor is enthusiastic about students ' learning in this 
course . 

14. The professor maintains a climate conducive to learning. 

15. The professor relates the subject to everyday life. 

16. Students are encouraged to express their own ideas. 

17. Students are encouraged to participate in discussions. 

18. A climate of mutual courtesy and respect is maintained. 



19 . The professor demonstrates interest in the progress of individual 
students . 

20. The professor is willing to provide outside help and guidance. 

21. The professor is sensitive to the needs and feelings of students. 

ENHANCEMENT OF LEARNING 

22. The professor arouses and maintains students' interest in the 
subject . 

23. Teaching methods stimulate interest in the course. 

24. The professor »s speech is audible and easily understood. 

25. Directions and explanations related to course content are clear. 

26. Thought -provoking questions are asked. 
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II?PFFECTIVK IN ENHANCING LEARNING = 1 
EFFECTIVE IN ENHANCING LEARNING = 2 
* HIGHLY EFFECTIVE IN ENHANCING LEARNING = 3 

27. Questions are asked that allow students to compare and contrast 
ideas . 

28. The professor draws students into discussions among themselves, 

29 . During classes students are encouraged to interact and learn 
from one cuiother. 



30, Topics are summarized before moving on to new topics, 

31. Important topics or ideas are summarized at the end of class. 



32. The professor helps students to organize information and under- 
stand relationships among the topics in the course. 

33. Difficult material is clearly explained. 

34. Students are encouraged to asic questions in class. 

35. Students' questions are clearly answered. 

36. Learning activities are implemented at an appropriate pace. 

37. Course content is at an appropriate level of difficulty. 

38. Difficult parts of the lesson are emphasized to help students learn. 

39. The professor seems to know when the students do not understand. 

40. When students are confused, the professor clarifies as needed, 
tl. Students receive feedback about their learning during the lesson. 



42. Adjustments are made in the lesson, as needed, to help students 
learn . 

43. Teaching aids (such as visuals) are used in a way that enhamces 
learning and broadens understanding, 

44. Learning materials (such as books, handout, lab equipment) are 
used in a way that enhances learning and broadens understanding. 

45. Students are encouraged to apply course content to solve problems 
or understand real life situations. 



STUDENT EVALUATION PRACTICES 

46. The basis for grading is made clear. 

47. The basis for the course grade reflects an appropriate balance 
among tests, papers, assignments, participation, etc, 

48. Tests reflect the course content. 

49. The test questions are clearly phrased. 

50. The tests are of reasonable length. 



51. The test questions provide a fair chance for students to demonstrate 
their knowledge of the subject. 

52. Course assignments are graded fairly, 

53, Tests and assignmejnts are returned in a reasonable length of time, 

54, Sufficient feedback is provided on all graded work. 



55. Students have opportunities to determine their own progress in 
the course . 

■ ■ ■■■■ ■ 
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PARTE 



- Types of Learning 



i DIRECf iOnS : Use the four-point scale below to evaluate the degree to which each type of 
learning is emphasized in this course. (DO NOT rate how much you have 
learned ...Only the amount of emphasis on each type of learning) . 



4 =s Very much emphasis 
3 = Much emphasis 
2 = Some emphasis 
1 = No emphasis 



Rate the emphasis placed on each type of learning listed below: 
56. learning factual information 



57. developing concepts 

58. understsmding cuid applying principles and rules 

59. tmderstsmding sind applying theories 

60. critical analysis and/or problem solving 

61 . creative thinking 

62. developing knowledge of self and others 

63. developing professional, career, and job-related skills 

64. developing written communication skills 

65. developing oral communication skills 



PART III - Overall Evaluation 



DIRECTIONS: Using the following grading scale, write in a number (not a letter 
grade) in responding to each of the following questions. 



A = 


90 - 100 


B = 


80 - 89 


C = 


70 - 79 


D = 


60 - 69 


F = 


Below 60 



66. How would you grade the quality of teaching in this course? 

Tens : 

Ones ^ . T ! 

67 . What was the contribution of the course to your learning? 

Tens ; . 

Ones ' ". [ : 7 

68. How would you grade this course overall? 

Tens " " . " ; " 

Ones 
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DEMOGRAPHIC INFORMATION 



1. Sex: 



. Female 
Male 



2. Age: 



Are you enrolled in a degree 
program? 

- Yes 

::No 

If you are in a degree program, 
what is your classif cation? 



~ Freshman 
i; Sophomore 
Junior 



: Senior 
Graduate 



Are you a full-time student 
(9 semester hours or more) ? 

" Yes 
" No 



9 . Have you taken a course through 
Continuing Education before 
this semester? 

Yes 
No 



11. At the beginning of the semester, 
what grade did you think you 
would be able to obtain in 
this course? 



under 21 
21 - 25 
26 - 30 
31 - 35 
36 - 40 



■41-45 
• 46 - 50 
"51-55 
over 55 



4. If yes, is this course part of your 
degree program? 

: Yes 
no 

6. If no, do you intend to enter a 
degree program? 

' Yes 
- No 



8 . Have you taken a course on the 
LSU campus (including courses for 
which you are currently enrolled) ? 

- Yes 

~ No 

10. If not, how long has it been since 
you last took a college course? 

This is my first course 

1-3 years 

4-9 years 

10 or more years 

12 . What grade do you expect 
to receive now? 



A 
B 
C 



D 
F 



A 
B 

C 



D 
F 
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Please comment on any other aspect of this course that impacts your 
learning (e.g., facilities, library resources, textbook, 
supplementary raaterials, etc.) Write your comments in the space 
provided . 



Approximately how long did it take you to fill out this form? 
Were the directions clear? If not, what was not clear? 



Are there any important aspects of teaching, learning or this 
course that were not included in this instrument? 



Are there any items that are not appropriate for this 
subject/course? 



THANK YOU FOR YOUR COOPERATION 1 



